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IMAGE PROCESSING METHOD, STORAGE MEDIUM, 



IMAGE FORMING APPARATUS AND PROGRAM 

BACKGROUND OF THE INVENTION 
Field of the Invention 

10 The present invention relates to an image processing method, a storage 

medium, an image forming apparatus and a program, all of which are to perform 
correction processing according to the attribute of an image. 
Related Background Art 

Conventionally, there is known color processing which is controlled 

15 according to the attribute of an image. 

In the conventional technology, however, single color processing (color 
correction, color conversion and binarization or other n-valued processing) is 
performed on a bit map obtained by decompressing compressed data. For this 
reason, color processing suitable for the attribute of the expanded bit map cannot 

20 be performed on the compressed data. 

The latest driver can switch color processing by analyzing color data 
developed into a bit map obtained by decompressing compressed data, but it has 
the disadvantage of notably reducing the processing speed because of the load 
involved in the processing for analyzing the data after it has been developed into 

2 5 the bit map. 

SUMMARY OF THE INVENTION 

It is an object of the present invention to resolve the above-mentioned 
disadvantage, and to enable image attribute discrimination of an image indicative 
30 of compressed data, and hence correction processing on the image indicative of the 
compressed data. 

The present invention has been made in view of the above-mentioned point. 
According to the present application, there is provided an image processing method 
for performing correction processing according to an attribute of an image, 
35 comprising the steps of: analyzing compressed data contained in a drawing 

instruction to determine whether its attribute is text, image or graphics; developing 
the compressed data to a bit map using a method corresponding to an analysis 
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result obtained in said analyzing step; and performing correction processing on the 
bit map according to the attribute of the image identified on the basis of the 
analysis result. 

Other characteristics of the present invention will become apparent from 
5 the following description of the preferred embodiment and the accompanying 
drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing a configuration of an information 
1 0 processing system to which an image processing/printing method according to an 
embodiment is applied. 

Fig. 2 is a conceptual diagram showing a flow of data from the time an 
image processing method control program and related data stored in a storage 
device of a medium reading device are read into a central processing unit until the 
1 5 data are sent to and printed on a printer in response to input of a print instruction 
from an input device. 

Fig. 3 illustrates details of image driver processing sections in the 
conceptual diagram of Fig. 2. 

Fig. 4 illustrates details of image driver processing sections in the 
2 0 conceptual diagram of Fig. 2. 

Fig. 5 is an illustration of typical print sample data, showing what data 
enable one to discriminate among a text, graphics and an image. 

Fig. 6 is a table showing what compressed data formats are attributed to the 
text, the graphic and the image, respectively. 

2 5 Fig. 7 shows a state in which the image processing method control program 

and related data are loaded into a computer through an FD (floppy disk). 

Fig. 8 shows a memory map of the image processing method control 
program stored in the FD. 

Fig. 9 shows a state in which the memory map of the image processing 

3 0 method control program stored in the FD is loaded from an auxiliary storage device 

into a main storage device through the medium reading device. 

Fig. 10 is a flowchart showing an embodiment of image driver processing. 
Fig. 1 1 is a flowchart showing an embodiment of PDL processing. 

3 5 DESCRIPTION OF THE PREFERRED EMBODIMENTS 
(Embodiment 1) 
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Hereinbelow, an embodiment of the present invention will be described in 
detail with reference to the accompanying drawings. 

Fig. 1 is a block diagram showing a configuration of an information 
processing system to which an image processing/printing method according to the 
5 present embodiment is applied. 

In Fig. 1 , a central processing unit 1 reads the program and related data 
stored in a storage medium such as an FD, a CD-ROM (compact disk read-only 
memory) or an IC (integrated circuit) memory card from a medium reading device 
6 connected to the system. A ROM (read-only memory) 8 is also provided. Then 
1 0 the central processing unit 1 accesses application software such as an OS 

(operating system) or spreadsheet software (hereinbelow called "the application") 
loaded from the auxiliary storage device 3 to the main storage device 2 to process 
information input from an input device 4. The processed information is output to 
an output device 5 or a printer 7. In the embodiment, the output device 5 is a 
15 display device, which is discriminated from the printer 7 to be categorized as the 
output device by definition. The input device 4 is composed of a keyboard, a 
pointing device and so on. The auxiliary storage device 3 may be a hard disk or 
magneto-optical disk or a combination of these disks. In addition, the embodiment 
may be such that these devices constituting the system in Fig. 1 are connected 

2 0 through a network. 

Fig. 2 is a conceptual diagram showing a flow of data from the time the 
image processing method control program and related data stored in the auxiliary 
storage device 3 of the medium reading device 6 are read into the central 
processing unit 1 until the data are sent to and printed on the printer 7 in response 
25 to input of a print instruction from the input device 4. In this case, both the 
application and a driver function under the control of the OS. 

Fig. 3 illustrates details of image driver processing sections in the 
conceptual diagram of Fig. 2. The image driver designates software which runs on 
a host side such as a PC to develop data to a bit map in accordance with drawing 

3 0 instructions sent from the OS so as to transmit the developed bit map data to the 

printer. 

When drawing instructions and compressed bit map data are sent from the 
OS, the image driver discriminates a format of the compressed data from the 
information contained in the drawing instructions (3-0 in Fig. 3). Based on the 
3 5 discrimination results, the image driver selects one of decompression processing 
methods (modules) preset or preprogrammed in the driver (3-1 in Fig. 3) to 
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develop the compressed data to a bit map (3-2 in Fig. 3). Then the image driver 
judges an attribute such as a text, graphics and an image from the compression 
format of the data to perform color correction processing appropriate to the 
attribute (3-3 in Fig. 3). Subsequently, the image driver performs color conversion 
5 (3-4 in Fig. 3) and two-valued or other n-valued (3-5 in Fig. 3) processing 

appropriate to the respective attribute to convert the processed bit map data to a 
device bit map. After completion of all the processing in accordance with the 
drawing instructions, the device bit map is transmitted to the printer. It should be 
noted that the color correction may be carried out concurrently with decompression 
10 of the data, or after the data have been decompressed and developed into the bit 
map. 

Fig. 4 illustrates details of PDL driver processing sections in the conceptual 
diagram of Fig. 2. The PDL driver designates software which runs on the host side 
to convert drawing instructions sent from the OS to a PDL (page-description 
15 language). The PDL is transferred to the printer and developed to a bit map inside 
the printer. 

When the drawing instructions and the compressed bit map data are sent 
from the OS, the driver converts the drawing instructions to the PDL (4-0 in Fig. 
4). The printer analyzes the PDL to judge a format of the compressed data from 

2 0 the information contained in the PDL (4-1 in Fig. 4). Then the printer selects one 

of decompression processing methods (modules) preset or preprogrammed as 
firmware of the printer (4-2 in Fig. 4) to develop the compressed data to a bit map 
(4-3 in Fig. 4). Next, the printer judges an attribute to the developed bit map, such 
as a text, graphics or a natural picture, from the compression format of the data to 
25 perform color correction processing appropriate to the attribute (4-4 in Fig. 4). 

Subsequently, the printer performs color conversion (4-5 in Fig. 4) and two-valued 
or other n-valued (4-6 in Fig. 4) processing appropriate to the attribute to convert 
the processed bit map data to a device bit map. After completion of all the 
processing in accordance with the drawing instructions, the driver notifies the 

3 0 printer of the completion in the form of the PDL so that the printer will transfer and 

print out all the bit maps on an output medium. It should be noted that the color 
correction processing may be carried out concurrently with decompression of the 
data, or after the data have been decompressed and developed to the bit map. 

Fig. 5 is an illustration of typical print sample data, showing what data can 
35 be used to discriminate among a text, graphics and an image. 

Text, as its name implies, indicates character data. 
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The term graphics indicates computer graphics such as a circle and a 
triangle shown in Fig. 5. Computer graphics includes other graphic elements such 
as a bar or circle graph, and a background picture for a presentation application. 

The term image indicates an image taken with a digital camera or the like. 
5 The image also includes a picture and the like created with a computer-based 
application. 

Image characteristics vary according to the attribute of the image. It is 
therefore necessary to change color processing, such as color correction, color 
conversion and two-valued or other n- valued processing, according to the 

10 characteristics of the image, so as to obtain desired color reproduction. Each type 
of image is considered to have characteristics as follows. For example, vivid 
colors tend to be used in graphics. It is therefore preferable to adjust the hue, 
saturation and brightness of colors in the color correction and conversion 
processing so that proper color discrimination will be obtained in the resultant 

15 image, thereby improving (or emphasizing) the vividness of the colors. On the 
other hand, continuity and gradation of colors are essential to the image. It is 
therefore preferable to perform color correction and color conversion so that the 
continuity of colors will be of high quality in the resultant image. It should be 
noted that the system may support JPEG-2000 compressed image data as the bit 

2 0 map data. In this case, a JPEG-2000 compressed data decompression module is 
prepared in the driver or printer shown in Fig. 3 or 4 so that the JPEG-2000 
compressed image will be supported as a discrimination target in the format 
discrimination step (3-0 in Fig. 3) or (4-1 in Fig. 4). If the JPEG-2000 compressed 
data is supported as the compressed bit map data, ICC profile information to be 

2 5 added to the JPEG-2000 compressed image can be used for color matching in the 
color correction and conversion processing (3-3, 3-4 in Fig. 3) or (4-4, 4-5 in Fig. 
4). Such additional information is not limited to the JPEG-2000. For example, if 
the format is identified as Exif, shooting conditions (such as use of a flash at 
shooting an image in the Exif file) to be added to the Exif file may be included in 

30 the drawing instructions. In this case, when the drawing instructions are analyzed, 
shooting conditions are anticipated from the shooting data so that proper color 
processing can be performed for color correction and color conversion (3-3, 3-4 in 
Fig. 3) or (4-4, 4-5 in Fig. 4). For example, a cool skin color caused by firing the 
flash is taken off to make skin tones vivid (glow emphasis), or red eye areas 

35 surrounded by skin tones are recognized to correct the red eyes caused by firing the 
flash (red-eye correction). 
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Fig. 6 shows an example of the correspondence between attributes and data 
formats, that is, it shows what compressed data formats are attributed to the text, 
the graphics or the image types of data. 

Since the image driver and the PDL driver are generally required to output 
5 high-quality images and a large amount of data needs processing, data formats 
which achieve more representable colors and greater compression rates are 
attributed to the image type. 

The other data formats with a limited number of colors are attributed to the 
graphics or the text type. 
1 0 Any method of discriminating among the attributes may be adopted, such as 

to discriminate among the image, the graphics and the text by analyzing the 
drawing instructions, or to discriminate among extensions like .jpeg and .png 
indicative of the type of (format) compression of image data (file) contained in the 
drawing instructions to identify the compressed data (format). 
15 Fig. 7 shows a state in which the image processing method control program 

and related data are loaded into a computer through an FD. Upon setting the FD in 
the medium reading device, the image processing method control program and the 
related data are read out of the FD under the control of the OS and a basic I/O 
(input/output) program already read in the main storage device. The image 
2 0 processing method control program and the related data move to the ready state 
when being loaded in the main storage device. 

Fig. 8 shows a memory map of the image processing method control 
program stored in the FD. 

Fig. 9 shows a state in which the memory map of the image processing 

2 5 method control program stored in the FD is loaded from the auxiliary storage 

device into the main storage device through the medium reading device. 

In the present embodiment, the image processing method control program 
is directly read from the FD into the main storage device through the auxiliary 
storage device so that the program will be executed. Alternatively, a copy of the 

3 0 image processing method control program may be saved from a storage medium 

such as the FD to the auxiliary storage device such as an HD (hard disk) so that the 
program will be read into the main storage device each time it is executed. 

Instead of the FD or HD, other media, such as a magneto-optical disk, a 
CD-ROM and an IC memory card may also be used to record the image processing 
35 method control program. Further, the image processing method control program 
may be stored in a ROM (read-only memory). 
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The image processing method is programmed on the basis of flowcharts of 
the image processing method shown in Figs. 10 and 11. 

Referring first to the flowchart of Fig. 10, an image print processing 
method using the image driver according to the embodiment will be described. 
5 At first, instructions for execution of printing are input from the input 

device 4 (Fig. 1). Of all the OS, the driver and the application (Fig. 2) read from 
the auxiliary storage device 3 (Fig. 1) into the main storage device 3 (Fig. 1), the 
OS receives the message or the instructions. Then the OS sends the printing 
execution message to the application that is currently active. 

1 0 The application converts the message to a command capable of being 

recognized by the OS to send data to be printed and the command message. Then 
the OS converts the message to a command capable of being recognized by the 
driver to send the command message. 

Upon receipt of the drawing instructions (step 10-0), the driver performs 

15 compression data format discrimination among the image, the text and the graphics 
on the drawing instructions that contain the compressed data using a discrimination 
method as cited in Fig. 6 (step 10-1). Each type of compressed data is 
decompressed by a method suitable for the relevant compression data format (step 
10-2), and color processing for color correction, color conversion and two-valued 

20 or other n- valued processing is performed on each type of expanded bit map data 
according to the type of compression data format identified in step 10-1 (step 10- 
3). Each of the processed data is developed to a bit map (step 1 0-4). Upon judging 
that all the drawing instructions have been completed (step 10-5), all the bit maps 
are transmitted to the printer (step 10-6). 

2 5 Referring next to the flowchart of Fig. 1 1, an image print processing 

method using the PDL driver will be described. 

Like in the image driver process, instructions for execution of printing are 
first input from the input device 4 (Fig. 1). Of all the OS, the driver and the 
application (Fig. 2) read from the auxiliary storage device 3 (Fig. 1) into the main 
30 storage device 3 (Fig. 1), the OS receives the message or the instructions. Then the 
OS sends the printing execution message to the application that is currently active. 

The application converts the message to a command capable of being 
recognized by the OS to send data to be printed and the command message. Then 
the OS converts the message to a command capable of being recognized by the 

3 5 driver to send the command message. Upon receipt of the drawing instructions 

(step 1 1-0), the driver converts the drawing instructions to a PDL to transmit the 
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same to the printer (step 11-1). Upon receipt of the PDL and compressed data, the 
printer performs compression data format discrimination among the image, the text 
and the graphics using a discrimination method as cited in Fig. 6 (step 1 1-2). Each 
type of compressed data is decompressed by a method suitable for the compression 
5 data format (step 11-3), and color processing for color correction, color conversion 
and two-valued or other n-valued is performed on each type of expanded bit map 
data according to the type of compression data format identified in step 11-2 (step 
11-4). Then each of the processed data is developed to a bit map (step 11-5). 
Upon a judgment being made that all the drawing instructions have been completed 

10 (step 11-6), all the bit maps are output (step 11-7). 

The above-described embodiment performed the described processing in 
response to input of the drawing instructions that contained compressed data. On 
the other hand, in a case in which the input drawing instructions contain 
compressed data mixing with data other than the compressed data, or image data 

1 5 other than compressed data, the drawing instructions are interpreted as to whether 
they contain compressed data. If the drawing instructions contain compressed data, 
a format of each compressed data is analyzed to judge an attribute of the image 
concerned. If the drawing instructions contain data other than compressed data, an 
attribute of each image is judged according to the kind of each drawing instruction 

2 0 in a manner as described in Japanese Patent Application Laid-Open No. 10- 
051651, the entire content of which is incorporated herein by reference. 

For example, in the case of graphics, the image is represented by data 
indicative of a drawing function for drawing a figure and a color of the figure. In 
the case of a text, the image is represented by data indicative of a text command 

2 5 and a color of the text. Thus, when the data contain a drawing function for 

drawing a figure, it is attributed to the graphics, while when the data contain a text 
command, it is attributed to the text. 

It should be noted that attributes of images are not limited to the above- 
mentioned text, graphics and image. For example, other attributes such as black 

3 0 characters and black-and-white images may be employed. 

Other compression data formats may also be employed. 

According to the above-mentioned embodiment, when an attribute of each 
image is determined on the basis of the kind of the drawing instruction concerned, 
a format of compressed data can be analyzed, thereby properly determining the 
35 attribute of data that have been identified as the image. 
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Further, the optimum color processing can be performed on the attribute of 
compressed data, which makes it possible to obtain excellent output results. 

Furthermore, there is no need to decompress the compressed data and 
analyze the expanded bit map data, which makes possible high-speed processing 
5 without putting an excessive load on the processing. In addition, the expanded bit 
map data do not need analyzing, which eliminates an error of judgment associated 
with the analysis process and improper color processing as a result of the 
misjudgment. 

Thus, color processing appropriate to the attribute of compressed data can 
10 be performed, and hence excellent output results can be obtained. 

Compared to a method in which bit map data obtained by decompressing 
and expanding compressed data need analyzing, the method according to the 
present embodiment can process bit map data at high speed without putting an 
excessive load on the processing. 
15 As described above, the present invention may be applied to a system 

constituted of two or more pieces of equipment (e.g., a host computer, interface 
equipment, a reader, a printer and so on), or a single apparatus (e.g., a copier or a 
facsimile). 

The present invention can also be such that the features of the above- 
2 0 described embodiment are implemented via software by supplying program codes 
as shown in Figs. 10 and 1 1 to an apparatus or a computer in a system connected to 
various devices. In this case, the implementation of the features of the above- 
mentioned embodiment by operating the various devices according to the program 
stored in the computer (CPU or MPU) of the system or the apparatus will also fall 

2 5 into the scope of the present invention. 

Since the software program codes themselves realize the features of the 
above-mentioned embodiment, the program codes themselves and means for 
supplying the program codes to the computer, that is, a storage medium for storing 
the program codes, will constitute the present invention as well. 

3 0 The storage medium for storing the program codes may be any storage 

medium such as a floppy disk, a hard disk, an optical disk, a magneto-optical disk, 
a CD-ROM, a magnetic tap, a nonvolatile memory card, a ROM, etc. 

The features of the above-mentioned embodiment are implemented not only 
by execution of the program codes supplied to the computer, but also by 
35 cooperating the program cods with an OS (operating system), under which the 
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program codes run on the computer, or other application software. In this case, the 
program codes, of course, are included in the embodiment of the present invention. 

The supplied program codes may be stored in a memory provided on the 
computer's extended board or in an extended unit connected to the computer. In 
this case, a CPU or the like provided on the extended board or in the extended unit 
executes part or all the processing on the basis of the program codes to implement 
the features of the above-mentioned embodiment. This case is also included in the 
present invention. 

In the above, the present invention has been described with reference to the 
preferred embodiment, but it is not limited to the above-mentioned embodiment, 
and various modifications are possible without departing from the scope of the 
appended claims. 

It should be noted that the present invention may be applied to a system 
constituted of two or more pieces of equipment or to a single apparatus. The 
present invention can also be applied to a case where the features are achieved by 
supplying a program to the system or the apparatus. 
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